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Abstract 

Background: The responsiveness of oral health-related quality of life (OHRQoL) instruments has become relevant, 
given the increasing tendency to use OHRQoL measures as outcomes in clinical trials and evaluations studies. The 
purpose of this study was to assess the responsiveness of the Brazilian Scale of Oral Health Outcomes for 5-year-old 
children (SOHO-5) to dental treatment. 

Methods: One hundred and fifty-four children and their parents completed the child self- and parental' reports of 
the SOHO-5 prior to treatment and 7 to 14 days after the completion of treatment. The post-treatment 
questionnaire also included a global transition judgment that assessed subject's perceptions of change in their oral 
health following treatment. Change scores were calculated by subtracting post-treatment SOHO-5 scores from pre- 
treatment scores. Longitudinal construct validity was assessed by using one-way analysis of variance to examine the 
association between change scores and the global transition judgments. Measures of responsiveness included 
standardized effect sizes (ES) and standardized response mean (SRM). 

Results: The improvement of children's oral health after treatment are reflected in mean pre- and post-treatment 
SOHO-5 scores that declined from 2.67 to 0.61 (p < 0.001) for the child-self reports, and 4.04 to 0.71 (p < 0.001) for 
the parental reports. Mean change scores showed a gradient in the expected direction across categories of the 
global transition judgment, and there were significant differences in the pre- and post-treatment scores of those 
who reported improving a little (p < 0.05) and those who reported improving a lot (p < 0.001). For both versions, 
the ES and SRM based on change scores mean for total scores and for categories of global transitions judgments 
were moderate to large. 

Conclusions: The Brazilian SOHO-5 is responsive to change and can be used as an outcome indicator in future 
clinical trials. Both the parental and the child versions presented satisfactory results. 



Introduction 

Dental caries and complicated traumatic dental injuries 
(TDI) have a negative impact on oral health-related 
quality of life (OHRQoL) in young children [1-5]. In 
Brazil, the prevalence of untreated dental caries is high 
(80%) at 5 years old according to the latest national epi- 
demiological survey [6], whereas TDI is an emerging 
and challenging, but mostly overlooked, public health 
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problem [7]. Consequently, it is important to assess the 
effectiveness of clinical interventions to treat these con- 
ditions, using quality of life as one of the key outcomes. 

The Scale of Oral Health Outcomes for 5-Year-Old 
Children (SOHO-5) was recently developed to assess the 
Oral Health Related Quality of Life (OHRQoL) in young 
children through both self- reports and proxy- reports [8]. 
Its cross-sectional validity, test-retest reliability and re- 
producibility properties were tested in previous studies 
[8,9]. Nevertheless, in order to be used as an outcome 
for the evaluation of an intervention, an instrument 
needs additional properties to detect minimally import- 
ant clinical changes after treatment. This latter property 
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is known as "responsiveness" [10]. Responsiveness is a 
key technical property, which assists researchers to 
choose the most appropriate measure for clinical trials, 
provide a basis for estimating sample sizes, and facili- 
tates interpretation of the change scores after treatment 
derived from the measures [11,12]. To date, the respon- 
siveness of OHRQoL instruments has become relevant, 
given the increasing tendency to use OHRQoL measures 
as outcomes in clinical trials and evaluations studies. 
However, there are still only a handful of studies on re- 
sponsiveness for schoolchildrens OHRQoL instruments 
[13-16] and scarce for preschool children [17,18]. Besides 
that, at present, the responsiveness of the SOHO-5, which 
is the only instrument available to assess child-self reports 
concerning OHRQoL, has not been established. 

The assessment of responsiveness also allows the cal- 
culation of the minimal important differences (MID) 
[10,19]. The MID is defined as 'the smallest difference in 
score, which patients perceive as beneficial and which 
would mandate, in the absence of troublesome side- 
effects and excessive cost, a change in the patients 
management' [20]. In essence, the MID provides a good 
indication of whether the observed change is meaning- 
ful. Consequently, an intervention may be justified if it 
can be shown to result in a change that exceeds the 
MID [21]. That is a stronger reason to the MID be 
assessed together the responsiveness. 

This study aimed to investigate the responsiveness of 
the Brazilian language version of the SOHO-5 to dental 
treatment. 

Methods 

This study was independently reviewed and approved by 
the Human Research Ethics Committee of the Dental 
School of the University of Sao Paulo. 

Study population 

There are no guidelines regarding the sample size 
needed for a study of responsiveness [22]. However, the 
sample size was calculated considering the following pa- 
rameters: 5% of standard error, 80% of power, a confi- 
dence level of 95%, mean scores for the pre-treatment 
questionnaires equal to 5.95 (±sd:3.10) and 10.79 (±sd: 
6.81) for the child and parental version, respectively. 
The mean scores for the post-treatment questionnaires 
were 3.45 (±sd:2.74) for the child-self report version and 
4.51 (±sd:4.78) for the parental version. These values 
were based in a previous study that validated the Brazilian 
version of the SOHO-5 [9]. Taking into consideration 
a possible lost of 30% during the follow-up, the mini- 
mum sample size that would be necessary to satisfy 
these requirements were estimated in 58 parents and 
37children for the child self-reported and parental 
version, respectively. 



Data were collected from 5-6-year-olds children and 
their respective parents who attended for dental screen- 
ing at the Dental School, University of Sao Paulo (USP), 
Brazil, in 2011. All children and parents were invited to 
participated in the study, according to the following in- 
clusion criteria: children who had not undergone dental 
treatment in the last three months, with no systemic dis- 
eases, with parents fluent in Brazilian Portuguese and 
who were willing to participate in the study. 

Study procedures 

On the same day of the dental screening, the child and 
one of the parents completed the Brazilian SOHO-5 in 
face-to-face independent interviews [9]. The interviews 
were conducted on the same day prior to the clinical 
examinations by four trained interviewers who were 
blind to the clinical findings. In addition, parents an- 
swered a question on family income. Seven to 14 days 
after the completion of treatment [13,17], the inter- 
viewer repeated a follow-up SOHO-5 to all those par- 
ticipating on the day of dental screening. In addition, a 
question to assess perceived change in children's oral 
health since the completion of treatment was done. 
Dentists that conducted the treatments were blinded to 
the participants responses to the SOHO-5 questions. 



Measure 

Oral health-related quality of life 

The Brazilian SOHO-5 considers the child's lifetime ex- 
perience of oral impacts in children and parents re- 
sponses [8,9] . It contains two versions of 7 items in each 
version (child and parental), with 6 of them being com- 
mon in terms of content. 

The 7 items of the child-self report version are: diffi- 
culty eating, difficulty drinking, difficulty speaking, diffi- 
culty playing, difficulty sleeping, avoid smiling (due to 
pain) and avoid smiling (due to appearance). Answers 
are given through a 3-point scale (no = 0, a little = 1, a 
lot = 2), aided by a prompt/explanation card with appro- 
priate faces. 

The 7 items of the parental version are: difficulty 
eating, difficulty speaking, difficulty playing, difficulty 
sleeping, avoid smiling (due to pain), avoid smiling (due to 
appearance), and affected self-confidence of the child. 
These are answered on a 5 -point scale (no = 0, a little = 1, 
moderate = 2, a lot = 3, a great deal = 4). 

The total SOHO-5 score for each version is calculated 
as a simple sum of the response codes. Since there were 
7 questions, the final score can vary from 0 to 14 for the 
child and from 0 to 28 for the parental version. A higher 
score denotes a greater degree of oral impacts on the 
quality of life of the child. 
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Global transition judgments 

Participants perceptions of change in their oral health 
since the completion of treatment at the clinic were 
assessed by a single item with a 5-point response scale 
('Worsened a lot'; 'Worsened a little'; 'Stayed the same'; 
Improved a little'; Improved a lot'). Such transition 
judgments are often used as a 'gold standard' when 
evaluating the sensitivity to change of health-related 
quality of life measures [19,23,24]. One advantage of 
these judgments appears to be that they are not affected 
by an individual's mood [25] . 

Statistical analysis 
Responsiveness 

Change scores for the scale were calculated by subtracting 
post-treatments scores from pretreatment scores [13-18,24]. 
Consequently, positive change scores indicate an im- 
provement in OHRQoL, while negative scores indicate 
deterioration. The responsiveness was assessed in differ- 
ent ways. The standardized effect sizes (ES) [26] and the 
standardized response mean (SRM) [27] have been widely 
recommended and used today as indicators of responsive- 
ness. Both provide direct information on the magnitude of 
change in the measure, expressed in terms of some meas- 
ure of variation in the change scores. The ES and SRM are 
calculated as ratios of the mean change score with the 
standard deviation of the baseline score and the change 
score, respectively. Both ES and SRM are expressed in 
standard deviation units and can be interpreted through 
conventional benchmarks [26] as indicating small (< 0.2), 
moderate (0.3-0.7) or large (> 0.8) effect. 

Following the approach of previous studies [14,24,28], 
paired t-tests were used to examine the significance of the 
within-subject change of those who changed and those 
who reported stability. If a measure is responsive, the 
former should be significant and the latter nonsignificant. 

The MID should be calculated through different 
methods. For distribution-based methods, this implies 
calculating ES and SRM. For anchor-based methods, this 
implies the global transition judgments for each version 
of the SOHO-5 using the mean change scores of those 
reporting that they "improved a little" in overall quality 
of life after treatment [19]. This value was also used to 
calculate Guyatt's responsiveness statistic [10]. The most 
appropriate indicator of responsiveness relates to the 
variability in test scores in stable subjects to the clinic- 
ally important difference [10]. Consequently, the index is 
given by the MID divided by the standard deviation of 
change scores for stable subjects. 

Longitudinal construct validity 

The longitudinal construct validity was assessed by using 
one-way analysis of variance to examine the association 
between change scores and the global transition 



judgments collected pos-treatment. Given the method of 
calculating change scores, good longitudinal construct 
validity is indicated if those reporting deterioration have 
negative mean change scores, those reporting stability 
have change scores close to zero, and those reporting 
improvement have positive change scores of increasing 
magnitude [22,24]. 

Results 

Response and characteristics of participants 

All the participants interviewed in this study completed 
all the items of the Brazilian SOHO-5, and no question- 
naires were excluded from data analysis due to missing 
data. The pretreatment SOHO-5 was completed by 193 
children and their parents, of whom 154 (79.8%) also 
completed the post-treatment SOHO-5. There were no 
statistically significant differences between the subjects 
who were lost in the follow-up from those who 
remained in the trial regarding baseline variables such as 
family income, gender, prevalence of impacts (SOHO-5 
score > 0) and age. Descriptive sociodemographic and 
clinical data for the sample are shown in Table 1. Global 
transition judgements from children and parental re- 
ports reported higher gradient of improvement of the 
children's oral health after treatment, however, only 3.9% 
and 6.5%, for child and parental reports, respectively, 
reported no change. There were no patients reporting 
any level of deterioration. The large majority of the sam- 
ple received operative treatment (71.4%), mainly focused 
on dental caries treatment (55.2%). 

Responsiveness 

Based on the global transition judgments results, the 
vast majority of children improved a little or a lot their 
OHRQoL in a higher frequency than those who did not 
change. These changes are reflected in mean pre- and 
pos-treatment SOHO-5 scores that declined from 2.67 
to 0.61 (p < 0.001) for the child-self reports, and 4.04 to 
0.71 (p < 0.001) for the parental reports (Table 2). These 
declining change scores indicated an improvement in 
children's OHRQoL. For child-self-report version, the ES 
and SRM for change total scores means showed to be 
moderate (0.7) and large (0.8), respectively, whereas for 
the parental version both indicators of responsiveness 
were moderate (0.6 and 0.7, respectively) (Table 2). 
These are estimates of the average treatment effect. 
Table 2 also shows ES and SRM of the SOHO-5 for each 
category of the global transition judgment. Regarding 
the child-self report version, ES and SRM for all those 
who reported improvement were moderate to large, as 
well as for those who reported stability. The small num- 
ber of subjects reporting no change means that the esti- 
mates for this category should be treated with caution. 
Regarding the parental version, the ES and SRM for all 
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Table 1 Sociodemographic and clinical data of the 
sample (N = 154) 



categories of global transition judgments were moderate 
with higher values for those that improved a lot com- 
pared to the other categories. 

For both versions of the SOHO-5, paired t-tests indi- 
cated that the mean scores in the pre- and post- 
treatment questionnaires of those who remained stable 
were not significantly different. Conversely, there was a 
significant difference in the pre- and post-treatment 
scores of those who reported improving a little (p < 0.05) 
and those who reported improving a lot (p < 0.001). 

The MID is given by the mean change scores of those 
who reported improving a little. This study indicates that 
for the child-self report and parental report of the 
SOHO-5, this is equal to 1.8. As the standard deviation 
of change scores in stable children were 0.8 and 6.0 for 
child-self reports and parental reports, respectively, 
Guyatt s responsiveness statistic equals 2.25 and 0.3. 

Longitudinal construct validity 

Mean change scores in both versions showed a gradient 
in the expected direction across categories of the global 
transition judgment, however, the magnitude of change 
were tenuous (Table 2). The child-self report version 
showed good longitudinal construct validity due to the 
fact that those reporting improvement have positive 
change scores of increasing magnitude and those 
reporting stability have a change score close to zero. The 
negative mean change score in this latter category is due 
to one child with a score of -2 (indicating deterioration), 
while the remaining five children of the stable category 
had a change score of 0 (Table 3). Moreover, there were 
significant differences of mean change scores within cat- 
egories of global transition judgments in the child self- 
report version (p = 0.04) (Table 2). 

Table 2 Mean change scores for total scores and within-group comparisons for total scores before and after treatment 
by global transition judgement (n = 154) 

Range in baseline Baseline mean (SD) Follow-up mean (SD) p- value* Mean change scores (SD) ES SRM 
Child- Self report version 

Total score 0-12 2.7(3.2) 0.6(1.1) <0,01 2.1(2.6) 0.7 0.8 

No change 0.2(0.4) 0.5(0.8) 0.36 -0.3(0.8) 0.8 0.4 

Improved a little 2.8(2.5) 1.0(1.3) <0.01 1.8(1.7) 0.7 1.0 

Improved a lot 2.8(3.3) 0.5(1.0) <0.01 2.2(2.7) 0.7 0.8 

p- valuet 0.04 
Parental version 

Total score 0-24 4.0(5.9) 0.7(1.4) <0,01 3.3(5.1) 0.6 0.7 

No change 2.4(7.6) 0.5(1.6) 0.34 1.9(6.0) 0.3 0.3 

Improved a little 2.7(5.3) 0.9(1.5) 0.02 1.8(4.1) 0.3 0.4 

Improved a lot 4.6(5.9) 0.7(1.4) <0.01 3.9(5.2) 0.7 0.7 

p- valuet 0.07 



Variables 


Category 


N 


% 


Age groups 


5 years-old 


89 


57.8 




6 years-old 


65 


42.2 


Gender 


Boy 


81 


52.6 




Girl 


73 


47.4 


Caries severity 


Caries free 


69 


44.8 




Low severity (def-t =1-5) 


45 


29.2 




High severity (def-t > 6) 


40 


26.0 


Trauma severity 


Absent 


103 


66.9 




Uncomplicated trauma 


26 


16.9 




Complicated trauma 


25 


16.2 


Household income* 


< 1 BMW 


43 


27.9 




> 1 BMW 


111 


70.1 


Type of received 
treatment 


With treatment (Operative) 
Without treatment (Preventive) 


110 

44 


71.4 
28.6 


Global transition 
judgement of children 
self reports 


No change 
Improved a little 
Improved a lot 


6 

24 
124 


3.9 

15.6 

80.5 


Global transition 
judgement of parental 
reports 


No change 
Improved a little 
Improved a lot 


10 
33 
111 


6.5 

21.4 

72.1 



*BMW = Brazilian Minimum Wage in 2011 (approximately $350 during the 
data gathered). 

def-t = decayed, indicated for extraction owing to caries and filled primary teeth. 



ES = standardized effect sizes; SRM = standardized response mean. 

*p-value derived from paired t-test. 

tp-values derived from one-way analysis of variance. 
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Table 3 Distribution of change scores for those who 
remained stable, improved a little and improved a lot 
(n = 154) 



Change 
scores* 


'Stayed the 
same' (n = 6) 


'Improved a 

Ii++Ia' In — *>/l\ 

little m — z4J 


'Improved a 
lot m — l zq) 


fhild-<;plf 

V.I1IIU bell 

report version 








-2 


1 


0 


0 


0 


5 


7 


50 


+1 to +3 


0 


13 


44 


> + 3 


0 


4 


30 


Parental 
report version 


'Stayed the 
same' (n = 10) 


'Improved a 
little' (n = 33) 


'Improved a 
lot' (n = 111) 


0 


9 


19 


29 


+1 to +5 


0 


12 


59 


+6 to +12 


0 


0 


14 


+13 to +18 


0 


1 


3 


> +19 


1 


1 


6 



*Change scores are calculated by subtracting post-treatments scores from 
pretreatment scores of the SOHO-5. 



The parental version showed moderate longitudinal 
construct validity taking into consideration that those 
reporting improvement had positive change scores 
among them; there were higher mean change scores for 
parents reporting that their children improved a lot than 
for those reporting that their children improved a little 
(Table 2). However, the mean change scores did not 
show an increasing magnitude across the no change' 
and 'improved a little' categories. There were no signifi- 
cant differences of mean change scores within categor- 
ies of global transition judgments in the parental 
version (p = 0.07) (Table 2). Table 3 showed the distri- 
bution of change scores by global transition judgment 
categories. It can be observed that there was an outlier 
with a change score of 19 in the 'no change' category of 
the parental version of the SOHO-5; which results in 
the change score increasing of this category. If this par- 
ent was excluded from the analysis, the difference of 
mean change scores within categories of global transi- 
tion judgments was significant (p = 0.012). 

Discussion 

OHRQoL measures can potentially be used in oral 
health surveys, clinical trials, studies evaluating the out- 
comes of dental care programs, and in clinical practice 
in terms of identifying need, selecting therapies and 
monitoring patient progress [29]. Depending on the use, 
different psychometric properties may be essential for an 
OHRQoL measure. In that respect, the assessment of re- 
sponsiveness and longitudinal construct validity, in 
addition to the standard properties of validity and reli- 
ability, are essential for using a measure in evaluating 



interventions. The Brazilian SOHO-5 has been proved 
valid, reliable, reproducible [9] and responsive to change. 

When considering the results of this study it is import- 
ant to discuss the nature of the sample in which we 
tested the Brazilian SOHO-5 responsiveness. The sample 
consisted of children of 5 to 6 years old and their re- 
spective parents who sought the dental screening at 
USP. Despite being a prospective patient sample, with 
expected volume of impacts, the large majority of children 
and parents reported low levels of impacts at baseline, and 
even though the mean change scores significantly declined 
after treatment, for total scores and within- categories of 
improvement. 

Furthermore, there are two major approaches to as- 
sess responsiveness and they can be categorized under 
two broader groups: distribution-based and anchor- 
based, also known as internal "internal responsiveness" 
and "external responsiveness", respectively [21,30,31]. 
The former compare the scores on a measure prior to 
and following an intervention and it uses the ES and 
SRM. In the anchor-based method, subjective global 
transition judgments can act as the anchor (reference) 
point. The present study encompassed both major ap- 
proaches considering that there does not appear to be a 
consensus in the literature on what constitutes a respon- 
sive measure nor, correspondently, how responsiveness 
should be quantified. However, the anchor-based method 
(external responsiveness) has meaning in a wider range 
of settings than the more context specific concept of 
internal responsiveness and, for that reason, is more ac- 
cepted and represents the best option for assessing re- 
sponsiveness and for selecting outcomes measures for 
clinical studies [31]. 

In this study, both versions of the SOHO-5 showed 
good internal and external responsiveness. First, the total 
SOHO-5 scores showed a large significant decrease fol- 
lowing treatment. ES and SRM were relatively similar in 
terms of magnitude of change observed in both ver- 
sions of the SOHO-5. In addition, both versions 
showed longitudinal construct validity expressed by the 
mean SOHO-5 change scores showing a gradient in the 
expected direction across the categories of the global 
transition judgment and significant differences between 
the change groups, though; in the parental version this 
was the case after excluding one outlier. However, the 
small number of subjects in the stable category for both 
versions may have influenced the longitudinal construct 
validity. 

In this study we did not have children and parents 
reporting deterioration in children's OHRQoL after 
treatment, precluding this analysis for that category. 
Nevertheless, we obtained children who improved a little 
and a lot and children who remained stable, and there 
are sufficient to facilitate assessment of changes. On the 
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other hand, our study would have more benefited having 
children and parents reporting deterioration in children's 
OHRQoL after treatment in order to better assess the 
longitudinal construct validity characteristics of this glo- 
bal transition judgment category. 

Comparing our results with other studies assessing the 
responsiveness of young children's OHRQoL instru- 
ments, we can observe that the English version of the 
Early Childhood Oral Health Impact Scale (ECOHIS) 
has demonstrated some limited ability to be very respon- 
sive to change due to low levels of impacts [17], whereas 
the Chinese version of the same instrument was respon- 
sive to dental treatment [18]. Both studies also followed 
internal and external responsivenesss criteria in their 
methods indicating through their results that the same 
measure cannot necessarily have the same technical 
properties in different samples. Therefore, it is important 
to mention that future versions of the original SOHO-5 
must been tested in terms of responsiveness before it 
use in clinical trials. Based on the results, the Brazilian 
SOHO-5 is an instrument available in Brazil for measur- 
ing the effectiveness of clinical interventions in order to 
select the one that provides a better quality of life for 
patients. 

Conclusion 

Taken together, the results of this study suggest that the 
Brazilian SOHO-5 is responsive to change and can be 
used in clinical trials. Both the parental and the child 
versions presented satisfactory results, however the 
child-self report version performed better. 
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